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Abstract 

We provide a new sufficient condition for strong invariance for differential inclusions, under very 
general conditions on the dynamics, in terms of a Hamiltonian inequality. In lieu of the usual 
Lipschitzness assumption on the multifunction, we assume a feedback realization condition that can 
in particular be satisfied for measurable dynamics that are neither upper nor lower semicontinuous. 

1 Introduction 

Topics in flow invariance theory provide the foundation for considerable current research in control theory 
and optimization (cf. [6, 7, 8, 10, 19, 22, 23]). The setting is that a multifunction F : R n =t W defining 
dynamics and a closed set S C R™ determining state constraints are given, and the theory then contains 
sufficient conditions under which some, or all, of the trajectories of F that start in S remain in S. 
More particularly, we say that (F, S) is weakly invariant in R™ provided for each ieS, there exists a 
trajectory 1 1— * 4>(t) of F starting at x that remains in S for all t before its escape time Esc(0, R") (precise 
definitions are given in section 2 below). Weak invariance of a set is also termed viability, and sufficient 
(and necessary) conditions for weak invariance have been developed under very general conditions on the 
dynamics, both in terms of tangential-type inclusions and Hamiltonian inequalities. 

A more restrictive invariance property is as follows: We say that (F, S) is strongly invariant in R" 
provided for each x G S, each trajectory t t—y <j>(t) of F starting at x remains in S for all t before its 
escape time Esc((/>, R"). In contrast with weak invariance theorems, which merely require the dynamics to 
have locally bounded values and closed graph, sufficient conditions for strong invariance usually invoke 
a Lipschitz condition on the dynamics (cf. section 3.2 for a survey of results in this direction). For 
example, if F is locally Lipschitz and nonempty and compact-convex valued with linear growth, then it 
is well known (cf. [7, Chapter 4]) that (F, S) is strongly invariant in R" if and only if F(x) C Tg(x) for 
all x G S, where Tg denotes the Clarke tangent cone. 

However, this cone characterization can fail if F is non-Lipschitz, as illustrated in the following simple 
example: Take n = l,S= {0}, F(0) = [-1, +1], and F(x) = {-sign(x)} for x ^ 0. Then T§ (0) = {0}, 
even though [F, S) is strongly invariant in R. This example satisfies our dynamic assumptions (cf. 
Example 2.2 below). It is also covered by our main theorem (see section 3). 

Starting from strong invariance and its Hamiltonian characterizations, one can develop uniqueness 
results and regularity theory for proximal solutions of Hamilton- Jacobi-Bellman equations, stability the- 
ory, infinitesimal characterizations of monotonicity, and many other applications (cf. [1, 7, 8, 15, 22]). 
On the other hand, it is well appreciated that many important dynamics are non-Lipschitz, and may 
even be discontinuous, and therefore are beyond the scope of the usual strong invariance characteri- 
zations. Therefore, the development of conditions guaranteeing strong invariance under less restrictive 
assumptions is a problem that is of considerable ongoing research interest. 
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This motivates the search for sufficient conditions for strong invariance for non-Lipschitz differential 
inclusions, which is the focus of this note. Donchev, Rios and Wolenski [10, 11] recently developed 
necessary and sufficient conditions for strong invariance for so-called one-sided Lipschitz differential 
inclusions. See also [19] for an autonomous normal type characterization of strong invariance for certain 
systems with a discontinuous component. These works apply under special conditions on the structure 
of the dynamics (cf. section 3 for further details). 

In this note, we pursue a very different approach. Rather than restricting the structure of the 
dynamics, we provide a sufficient condition for strong invariance under an appropriate feedback realization 
hypothesis. This hypothesis is related to Sussmann's 'unique limiting' property that was introduced in 
[21] in the context of exit time optimal control problems with continuous dynamics, and to Malisoff's 
"Lipschitz upper envelope" condition from [17, 18]. Roughly speaking, our realization property states 
that each trajectory 4> of the dynamics F is also a unique trajectory of a nonautonomous singleton- valued 
dynamics / for which f(t,x) G cone{F(x)} for all t and all x near (f>(0) (cf. section 2 below for a precise 
statement of our hypothesis). This is a less restrictive assumption than those of the known strong 
invariance characterizations because it can be satisfied by important classes of differential inclusions 
with measurable, but possibly neither upper nor lower semicontinuous, right-hand sides (cf. section 2 
for examples). While our main theorem can be shown using Zorn's Lemma, the proof we give below is 
constructive, and in particular leads to a new approach to building viable trajectories for Caratheodory 
dynamics; see Remark 4.1. 

In section 2, we state our realization hypothesis precisely and provide the necessary background on 
differential inclusions and nonsmooth analysis. We also illustrate the applicability of our hypothesis to 
a broad class of discontinuous dynamics that are beyond the scope of the well known strong invariance 
results. In section 3, we announce our strong invariance result and discuss its relationship to the known 
theorems in strong invariant system theory. Section 4 contains the proof of our strong invariance criterion, 
and we close in section 5 by proving a new necessary and sufficient Hamiltonian condition for strong 
invariance for general lower semicontinuous feedback realizable dynamics. 

2 Assumptions and Preliminaries 

2.1 Basic Hypothesis 

Our main object of study in this note is an autonomous differential inclusion x G F(x). In this subsection, 
we state our hypothesis on F and illustrate its relevance using several applications. Our novel feature is 
the requirement that each trajectory of F be realizable as the unique solution to a nonautonomous local 
feedback selection of F. On the other hand, we will not require the Lipschitz property or other structural 
assumptions on F that are generally invoked in strong invariant system theory (cf. [7, 9, 10, 15, 19]). 

To make our realization hypothesis precise, we require the following definitions and notation. By a 
trajectory of x G F{x) on an interval [0, T] starting at a point x G R™, we mean an absolutely continuous 
function <f> : [0, T] -> R™ for which 0(0) = x a and <p(t) G F(<j>(t)) for (Lebesgue) almost all (a.a.) t G [0, T]. 
We let Traj T (F, x) denote the set of all trajectories 4> : [0, T] — ► R" for F starting at x on all possible 
intervals [0, T], and we set Traj(.F, x) := UT>oTra,j T (F,x) and Traj(F) := U xe RnTraj(.F, x). 

A multifunction G : R" =4 R™ is said to have linear growth provided there exist positive constants 
Ci and C2 such that \\v\\ < c\ + c 2 ||x|| for all v G G{x) and x G R™, where || • || denotes the Euclidean 
norm. For any interval /, a function / : I x R™ — > R™ is said to have linear growth (on I) provided 
x i ► G(x) := {f(t, x) : t £ 1} has linear growth. For any sets D, M C R™ and n G R, we set M + r/D := 
{m + r]d : m G M,d G D}, and conc{L>} := U{r/D : rj > 0}. Also, B n (p) := {x G R™ : \\x - p\\ < 1} 
for all p G R n and B n := B n (0). A function ui(-) : [0, oo) — > [0, oo) is called a modulus provided it is 
nondecreasing and continuous with w(0) = 0. For each T > 0, we let C[0, T] denote the set of all functions 
/ : [0, T] x R" R" that satisfy 

(Ci) For each x G R™, the map t ^ f{t,x) is measurable; 
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(C 2 ) For each compact set K C R™, there exists a modulus cj/^O) such that, for all t G [0,T] and 
zi, x 2 G if, \\f(t,xi) - f(t,x 2 )\\ < ujf, K (\\xi - x 2 \\); and 

(C3) / has linear growth on [0,T]. 

It is noteworthy that Uf #-(•) in the previous definition is independent of t G [0,T]. For each a; G R™, 
denote by C F ([0,T],x) those / G C[0,T] that are also selections of the cone of F for almost all t G [0, T] 
and all 16R" sufficiently near x; that is, 

C F ([0,T],x) := {/ G C[0,T] : 3 7 > s.t. /(i,x) G cone{F(x)} for a.a. t G [0,T] and all x G ■yB n (x)}. 

Notice that while elements / G Cf([0,T],x) are defined on all of [0,T] x R™, they are only required to 
satisfy f(t,x) G cone{F(x)} on part of their domain. We also let Cf[0,T] denote those / G C[0, T] such 
that f(t,x) G cone{F(x)} for almost all t G [0, T] and all x G R™. We will assume the following: 

(t/) For each x G R", T > 0, and <p G Traj T (F,x), there exists / G C F ([0,T],x) for which <\> is the 
unique solution of the initial value problem y(t) — f(t, y(t)), y(0) = x on [0, T]. 

Notice that hypothesis (U) is weaker than requiring a continuous selection from the dynamics F that 
realizes the trajectory. This is because / is allowed to depend on time as well as the state, and need only 
be a local selection. Moreover, / is allowed to depend on the choice of the trajectory <j>, and need not be 
continuous. In practice, hypothesis (U) can be checked using open or closed loop controls, and may be 
satisfied for non-Lipschitz dynamics. The following examples illustrate these points and also show how 
to use cones to check condition ({/). 

Example 2.1. Assume F : R™ =4 R" is Lipschitz and nonempty and compact-convex valued. We claim 
that F satisfies condition (U). To see why, let x G R", T > 0, and <p £ Traj T (.F, x) be given, and set 

f(t,x) = proj F(x) (<^(i)) 

(i.e., f(t,x) is the closest point to <j>(t) in F(x), which is well defined by the convexity of F(xj). Then 
/ G Cf[0, T] satisfies the requirement. If on the other hand F : R =4 R is defined by F(x) — {1} for x < 0, 
F(0) = {0}U[1,2], and F(x) = [0,2] for x > 0, and if G Traj(F), then f(t,x) = (j){t) G cone{F(x)} for 
almost all t and all x G R™. Therefore, condition (U) is again satisfied, even though F is neither upper 
nor lower semicontinuous nor convex valued. 

Example 2.2. Consider the example from the introduction, namely, n = 1, F(Q) = [— 1,+1], and 
F(x) — {— sign(x)} for i/O. We claim that (U) is again satisfied. To see why, let T > 0, x G R, and 
<j> G Traj T (F, x) be given. Note that (F, {0}) is strongly invariant in R. Therefore, either (i) <j> starts 
at some x ^ and then moves to at unit speed and then stays at or (ii) = 0. If x ^ 0, then the 
requirement is satisfied using 

f{t,x) = -sign(x)/3(i), 

where (3(t) = 1 if t G [0, |x|] and otherwise. In this case, f(t,x) G cone{F(x)} for all t G [0,T] and 
x G (|x|/2)£>i(x). If instead x — 0, then the requirement is satisfied with f(t,x) = G cone{F(x)} for 
all t G [0, T] and x G R. 

Example 2.3. Assume F(x) = g(x,A)U(x) where A C R m is compact, and g : R n x A -» R™ is 
continuous in x G R™ and measurable and satisfies 

(H) For each compact set K C R™, there exists > such that for all Xi,X2 G K and a e A, 
(g(x\,a) — g(x 2 ,aj) ■ (xi — x 2 ) < Lk\\x\ — x 2 || 2 . Also, x g(x, ^4) has linear growth. 

and U : R™ =4 R is bounded, measurable, closed and nonempty valued, and satisfies U(x) n (0, 00) 7^ 
and C/(x) n (— 00, 0) 7^ for all x G R™. (The argument we are about to give still applies if instead of 
assuming that U{x) n (0, 00) ^ and U (x) n (—00, 0) 7^ for all x G R™, we instead assume that either 
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U : R™ =3 (0,oo) or U : R n =4 (-00, 0).) One can easily check (cf. [2]) that condition (i?) guarantees 
existence of at most one solution <p '■ [0, T] — ► R" of x = g(x,a)/3 for each initial condition, T > 0, 
and bounded measurable functions a : [0, T] — > A and /3 : [0, T] — > R. To check condition (U), let 
£ Traj(F). Consider the multifunction 

G(t) := {(a, tjeix E/(#i)) : 4>(t) = g^t), a)b}. 

Notice that t h Ax U(<p(t)) is closed valued and measurable, and that (t, (a, b)) 1— ► g((f>(t),a)b is 
measurable. Applying the (generalized) Filippov lemma (cf. [22, p. 72]) to G, we find a measurable pair 
(a, /3) for which a(t) £ A, (3(t) £ U(<j>(t)), and <j>(t) = g((j)(t),a(t))/3(t) for almost all t. We now show 
that condition (U) holds with the choice 

f(t,x) := g{x,a(t))(3(t)- 

In general, we will not have (3(t) £ U(x) for all t and x. In fact, it could be that U(<j)(t)) fl = for 
some t and x, so we may not have f(t,x) G ^(2;) for a. a. i and x. On the other hand, one can easily 
check that (3{t) £ cone{/7(x)} for all t and x, so f(t,x) £ 5(2;, A)cone{[/(x)} = cone{F(x)} for a. a. t 
and all x, and this gives the desired result. 

Example 2.4. Let R C M™ be compact and F(x) = {A(x) + [7(a;)5(a;)}i2, where (i) 5, A : R n R arc 
continuous functions such that |A(x)| > 2|<5(x)| for all x, (ii) g(x,A) := X(x) + AS(x) satisfies condition 
(H) above with n = 1 and A = [—1, +1], and (iii) U : R" — > [—1, +1] is measurable. To check condition 
([/), let <f> £ Traj(F). Applying the Filippov lemma as in the previous example, we find measurable 
functions u and r such that <p(t) = [\((j)(t)) + u(t)5((j>(t))]r(t) for almost all t, with u(t) = U(cj>(t)). 
Notice that 

X(x) + U(y)5(x) £ (min{A(x)/2,3A(x)/2},max{A(x)/2,3A(x)/2}) 

for all x and y, by our stated conditions. This implies that X(x) + U(y)S(x) £ cone{A(x) + U(x)S(x)} 
for all x,y £ R™, so we can satisfy condition (U) using f(t,x) := [X(x) + u(t)S(x)]r(t). In this case 

/eC F [o,T]. 

2.2 Preliminaries in Nonsmooth Analysis 

The principal nonsmooth objects used in this note are the proximal subgradient and normal cone, and 
here we review these concepts; see [7] for a complete treatment. Let S C R™ be closed and s £ S. A 
vector ( £ R™ is called a proximal normal vector of S at s provided there exists a — a((, s) > so that 

((,s' -s) <<t\\s' -s\\ 2 for all a' e S. (1) 

The set of all proximal normals of S at s is denoted by Ng(s) and is a convex cone. One can show (cf. 
[7, p. 25]) that for each S > and s £ S, ( £ Ng(s) if and only if there exists a = a((, s) > so that 

(£«' -s) < -s|| 2 for all a' £ S n 5B n (s). (2) 

Recall that the distance function ds(-) ■ R™ — > R is given by ds(x) :— min{||x — s\\ : s £ S}. 

For the related functional concept, assume / : R™ — > (— exo, 00] is lower semicontinuous and let 
x e domain(/) := {x 1 : f(x') < 00}. Then ( £ R" is called a proximal subgradient for / at x provided 
there exist a > and ry > so that 

iV) > f(x) + (C, x' - x) - a\\x' - x|| 2 for all x' £ r]B n (x). (3) 

The set of all proximal subgradients for / at x is denoted by dpf(x). This set could be empty at some 
points, even for C 1 functions (e.g., 9p/(0) = if f(x) — — |x| 3//2 ). 

We next state the version of the Clarke-Ledyaev Mean Value Inequality needed for our strong invari- 
ance results. Let [x, Y] denote the closed convex hull of x £ 1" and FCK". 
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Theorem 1. Assume x G R™, Y C R™ is compact and convex, and '3/ : R™ — > (oo,+oo] is lower 
semicontinuous. Then for any 5 < min^y ^(y) — ^(x) and X > 0, there exist z G [x,Y] + XB n and 
C G d P ^{z) so t/iat (5 < (C, y - x) for all y eY. 

For the proof, see [7, p. 117]; an infinite dimensional version also holds (see [5]), but is not needed here. 
2.3 Background in Differential Inclusions 

In this subsection, we review invariant systems theory and a standard result on compactness of trajectories 
for discontinuous dynamics. The following definition of escape times was introduced in [23]: 

Definition 2.5. Let Q G R™ be open, xq G Q, and x(-) be a trajectory of a differential inclusion x G F(x) 
with x(0) = xq defined on a half-open interval [0, T), where < T < oo. Then T is called an escape 
time of x(-) from (/ provided at least one of the following conditions hold: 

(£i) T = oo and x(t) G 5 for all t > 0; 

(£2) z(f) G G for all f G [0, T) and ||x(f)|| -> 00 as i | T; or 

(£3) T < 00, ar(i) G 5 for all t G [0,T), and <ig=(x(i)) -> as t | T. 

We next define strong and weak invariance. Assume Q C R" is open and x G Q. The set of all 
trajectories of F originating from xq that remain in Q over a maximal interval is denoted by T(^g)(a;o). 
Therefore, Y^g^zo) consists of those absolutely continuous functions x(-) defined on a half-open interval 
[0, T) for which x(0) = x a and x(t) G F(x(t)) is satisfied for almost all t G [0, T], where T = Esc (x(-); Q). 

Definition 2.6. Assume E C M™ is closed, and ^ G R" is open with £n^0- Let F : M™ =4 R". 

(a) (F, E) is called weakly invariant in Q provided that for every x G E (~l 5, there exists a trajectory 
z(') G T (Fi£;) (xo) that satisfies G E for all t G [0, Esc (x(-); Q)). 

(b) (F, E) is called strongly invariant in Q provided for every x G E, every trajectory x(-) G T (x ) 
satisfies a;(t) G E for all f G [0, Esc (x(-); 0)). 

For Hamiltonian characterizations of strong invariance for locally Lipschitz dynamics, see [7] . See also 
[10] for a characterization of strong invariance for systems satisfying appropriate one-sided Lipschitzness 
and dissipativity conditions, and [11] for general one-sided Lipschitz dynamics (with a modified Hamil- 
tonian). Our main contribution will be a new sufficient condition for strong invariance for dynamics 
satisfying the realizability condition (U), including cases where F is neither lower nor upper semicontin- 
uous and not tractable by the known strong invariance results. Our condition is a Hamiltonian inequality 
involving a lower semicontinuous verification function. However, necessity is not true generally, and it is 
not clear what or if a modification of the inequality can be made to ensure a complete characterization. 

The following is a variant of the well known "compactness of trajectories" lemma. This result says 
more than just that a bounded set of solutions is relatively compact. Rather, a stronger conclusion holds 
in that approximate trajectories have subsequences that converge to a trajectory. The proof is a special 
case of the compactness of trajectories proof in [7]. 

Lemma 2.7. Let x G R", T > 0, / G C[0,T] be also continuous in t, and {y t : [0, T] R"} be a 
sequence of uniformly bounded absolutely continuous functions satisfying yi(0) — x for all i. Assume 

Vi{t) G f{n{t),yi{t) + n{t)) + 5i(t)B n for a.a. t G [0,7] (4) 

for all i, where {Si(-)} is a sequence of nonnegative measurable functions that converges to in L 2 as 
i — ► 00, {ri(-)} is a sequence of measurable functions converging uniformly to as i — > 00, and {n(-)} 
is a sequence of measurable functions converging uniformly to t on [0,T] as i — > 00. Then there exists a 
trajectory y of y = f(t, y), y(0) = x such that a subsequence of yt converges to y uniformly on [0, T}. 



5 



We will apply Lemma 2.7 to continuous mollifications of our feedback maps / G C[0,T]. More 
precisely, set 




where the constant C > is chosen so that J R rj(s)ds — 1. For each e > and fel, set 

^(|). 

Notice for future use that 

( r, £ {t)dt = 1 Ve > 0. (5) 
Define the following convolutions of / G C[0,T] in the t- variable: 

f e (t,x):= / f(s,x)r) £ (t- s)ds (= / f(t- s,x)r)e(s)ds) (6) 
Jr \ Jm / 

with the convention that f(s,x) = for s ^ [0, T]. Then / e G C[0,T] and is continuous for all e > 0. (In 
fact, / e is a C°° function of t for each x G R™, but we will not need this fact. See [12, 13] for the well 
known theory of convolutions and mollifiers.) We will apply Lemma 2.7 to a sequence / := f £ ^ with 
e(i) > converging to zero. In this case, we will use ideas from the standard proof that 

fe(i)(;x)^ f(-,x) in Li[0,T] V,ieR" 

to build trajectories of / G C[0,T] that respect the state constraint. 

Remark 2.8. Note for later use that if Ti(t) = t in Lemma 2.7, then the conclusions of the lemma 
remain true even if the i-continuity hypothesis on / G C[0, T] is omitted. This follows from the proof of 
the compactness of trajectories lemma in [7]. 



3 Strong Invariance Theorem 

3.1 Statement of Theorem and Remarks 

Let Hp ■ K" xP^ [— oo, +oo] denote the (upper) Hamiltonian for our dynamics F; i.e., 

H F (x 1 p) := sup (v,p). 

veF(x) 

For any subset D C R™, we write Hp(x, D) < to mean that Hp(x, d) < for all d G D. By definition, 
this inequality holds vacuously if D = 0, e.g., if D is the empty set of proximal subdifferentials of a 
function at some point. 

Theorem 2. Let F : M. n R n satisfy (U), let ^ : W l — > (— oo, +oo) be lower semicontinuous, and set 
S = {x G M. n : ^>(x) < 0}. If there exists an open setU C M™ containing S for which Hp{x,dp^(x)) < 
for all x G U, then {F,S) is strongly invariant in R™. 

We prove Theorem 2 in section 4 by constructing appropriate Euler polygonal arcs; see also Remark 
4.1 for an alternative nonconstructive proof based on Zorn's Lemma. Theorem 2 differs from the usual 
strong invariance statements in the manner in which the set S is described, but it allows for some 
interplay between constraint and data assumptions. Note that we require the Hamiltonian inequality in 
a neighborhood U of <S, for the result is not true in general if the Hamiltonian condition is placed only 
on <S, even if ^> and F are smooth. For example, take n = 1, fy(x) = x 2 , and F(x) = {1}. In this case, 
S = {0} and Hp(0, dp^(0)) = 0, but (F, S) is not strongly invariant. On the other hand, Example 2.2 is 
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covered by Theorem 2, once we choose the verification function *f>(x) = x 2 . In this case, the Hamiltonian 
condition reads Hf{x,^'(x)) = — 2a;sign(a;) = —2\x\ < for all i 6 I, so our sufficient condition for 
strong invariance is satisfied. 

Theorem 2 contains the usual sufficient condition for strong invariance for an arbitrary closed set 
S C R™ by letting be the characteristic function Is of S; that is, Is(x) = if x G S and is 1 otherwise. 
Then d P V(x) = {0} for all x & boundary (S) , and d P ^(x) = Ng(x) for all x G boundary (S). This 
implies the following special case of Theorem 2: 

Corollary 3.1. Let F : 1" =t K" satisfy (U) and S C R" be closed. If H F (x,Ng(x)) < for all 
x G boundary (S), then (F, S) is strongly invariant in R". 

The converse of Corollary 3.1 does not hold, as illustrated by the simple example given in the intro- 
duction. This means that the converse of Theorem 2 does not hold. 

Remark 3.2. Theorem 2 remains true (by the same proof) if its Hamiltonian inequality is replaced by: 
(f(t,x),p) < for all T > 0, x G R™, / G C F ([0,T],x), t G [0,T], x G U, and p G d P V(x). 

3.2 Relationship to Known Strong Invariance Results 

Theorem 2 improves on the known strong invariance results because it does not require the usual Lipschitz 
or other structural assumptions on the dynamics. The papers [4, 6, 15, 16] provide strong invariance 
results for locally Lipschitz dynamics (see also [7, Chapter 4] ) . In [4] , Clarke showed that strong invariance 
of (F, S) in R™ is equivalent to 

F{x) C 7g(x) VxeS (7) 

where Tg is the Clarke tangent cone (cf. [7]). Recall that v G Tg(x) if and only if for all sequences Xi G S 
converging to x and all sequences U > decreasing to 0, there exists a sequence V\ G 1" converging to 
v such that Xi + Uvt G S for all i. In particular, if S = {0}, then Tg (0) = {0}. Later, Krastanov [16] 
gave an infinitesimal characterization of normal-type, by showing strong invariance is equivalent to the 
following: Hp(x, Ng (x)) < for all x G S. See [3, 6] for Hilbert space versions, and [15, 22] for other 
strong invariance results for Lipschitz dynamics and nonautonomous versions. 

Donchev [9] extended these characterizations beyond the autonomous Lipschitz case to "almost con- 
tinuous, one-sided Lipschitz" multifunctions. Rios and Wolcnski [19] proved an autonomous normal-type 
characterization that allows for a discontinuous component. Donchev, Rios, and Wolcnski [10] proved a 
necessary and sufficient condition for strong invariance for a discontinuous nonautonomous differential 
inclusion F : R" xl=( R™ whose right-hand side is the sum of an almost upper semicontinuous dynamic 
D(t,x) with nonempty compact convex values that is dissipativc in x, and an almost lower semicontinu- 
ous multifunction G(t, x) that is one-sided Lipschitz in x. In terms of the nonautonomous Hamiltonians 
defined for any dynamics R by 

H R (t,x,C):= sup (v,(), 

v£R(t,x) 

the main result of [10] says: If S C R" is closed, then (D + G, S) is strongly invariant in 1" if and only 
if there exists a subset I C 1 of full measure in 1 such that 

H G (t,x,Ng(x))-H D (t,x,-Ng(x)) < V(t,x)eIxS. 

This result applies to cases where the Clarke tangency condition (7) is not satisfied, and covers the 
example in the introduction. They have gone further in [11] to provide a characterization of the general 
one-sided Lipschitz case, in which the Hamiltonian is replaced by a limiting condition. 

On the other hand, Theorem 2 does not make any structural assumptions on the dynamics. Moreover, 
our feedback realizability hypothesis (U) can be satisfied for dynamics that are not tractable by the well 
known strong invariance results. For instance, see the examples in section 2. 
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4 Proof of Strong Invariance Theorem 

This section is devoted to the proof of Theorem 2. 

Fix T > and x E S. We first develop some properties that hold for all / E Cf([0,T],x). Fixing 
/ 6 Cf([0, T],x) and e > 0, and fixing 7 > such that f(t,x) E cone{F(x)} for all x E jB n (x) and 
almost all t E [0,T], set 



G%z,fc] = co{f £ (t,y) : \\y - x\\ < C 



(8) 



for each t S [0, T], x e R™ and fceN, where / e is the regularization of / defined by (6) and co denotes 
the closed convex hull. This is well defined because / E C[0,T]. By reducing 7 > as necessary, we can 
assume that jB n {x) C U. We also set 

g £ f [t,x,k] = l + max{||p|| : p E G e f [t, x, k] } 

for all t E [0,T], x E M 71 , and k E N. Note that 



g}[t,x,k] < g f [t,x,k] := 1 + d + c 2 ^||x|| + Vi e [0,T],xE l",ieN 



(9) 



where Ci and c 2 are the constants from the linear growth requirement on /, so the sets G e ^\t,x 1 k] are 
compact. The following estimate is based on Theorem 1 from section 2: 

Claim 4.1. If x E %B n (x), t > 0, k E N, and h > are such that 

0<h<— -1 - and x + hg f [t,x,k]B n C?lB n (x), (10) 

Zr£ g j-' [t, X, /cj o 

then 

+ hv) < + ^ (11) 
k 

holds for some v E Gj[t,x,k}. 

Proof. Suppose the contrary. Fix x E ^B n (x), t > 0, k E N, and h > satisfying (10) but such that 

*(x + to) > + \ Vv EG £ f [t,x,k}. (12) 

It follows that 

J:=A<min%)-%), (13) 

where Y = x + hGj[t, x, k]. This is because <3/ is lower semicontinuous. Let A E (0, j^) be such that 

x + hg f [t,x,k]B n + XB n c 7 B n (s). (14) 

Next we apply Theorem 1 with the choices Y = x + hGf{t, x, k] and <5 defined by (13). It follows that 
there exist z E [x, Y] + XB n and ( E dp^(z) for which 

5 < min(£, y — x) = min (C,,hv). (15) 

y€Y vGG E f [t,x,k] 

Note that z E jB n (x) C U, by (14). Since z E [x, Y] + XB n , (10) combined with the choice of A gives 

\\z — x\\ < hgf[t, x, k] + A < j. 
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Therefore f £ (t,z) G G £ f[t,x,k], by the definition (8) of G S f[t,x,k]. Since f(s,z) <E cone{F(z)} for a. a. 
s E [0, T] (by our choice of 7 > 0), our Hamiltonian hypothesis gives {(,f(s,z)) < for almost all 
s e [0,T]. Therefore, (15) gives 



(16) 
□ 



(17) 



< S < h((,f E (t,z)) = h / rie(t-s)((,f(s,z))ds < 0. 

Jr 

The contradiction (16) concludes the proof of Claim 4.1. 
Now set 

D:=^B n (x)CU. 

Let be a modulus of continuity for a; 1— » /(i, a;) on K := D + B n for all t € [0, T]. Such a modulus 
exists by condition (C2). Then U}\k is also a modulus of continuity of K 3 x / £ (t, a;) for all t e [0, T] 
and e > 0. The following estimate follows from Caratheodory's Lemma (cf. [20, p. 55]): 

Claim 4.2. Let (t,x,k) e[0J]xDxN and v e G^[i, 2:, fc]. Then ||v - / e (i, a;)|| < u f . K (l/k) + l/k. 

Proof. Using the Caratheodory Lemma and the definition of Gj[t, x, k], we can write 

n 

v = A + ^2ajf e {t,Xj), 

3=0 



where 



a,- e [0, 1] Vj, £>i = l, \\xj-x\\<l/k^j, ||A||<l/fc. 

3=0 



In particular, Xj € K for all j. This gives 

\\v-f e (t,x)\\ < 



3=0 



J2 a j{fe(t,Xj) - f £ (t,x)} 
3=0 



as desired. 
Next define 

6(D) ■=l + c 1 + c 2 + c 2 sup{||w|| : v e D}. 
It follows from the estimate (9) that 

G e f [t,x,k] C6(D)B n Vt e [0,T], x £ D, keN. 

Next set 



□ 



T := min <^ T. 



8<5(D) J ' 



Choose N > 2 such that 



and ft-fe := 



2 7, 



Ak8(D) 



D + h k 6(D)B n C -^B n (ic) Vfc>7V. 



By the choices of 7 and <5(D), 

< /ife < 



2kg f [t,x 1 k] 



Vt e [0,T], a; e £>, k e N. 



(18) 
(19) 
(20) 

(21) 



Set c(fc) = Ceiling (T/hk), i.e., c(fc) is the smallest integer > T/hk- For each k > N, we then define a 
partition 



ir(k) :0 = t , k <h, k < ... <t 



c(k),k 
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by setting U t k = i»-i,k + ftfc for i = 1, 2, . . . , c(k) — 1. Since 

f-h k < [c(k) - l]h k < f 
for all k, it follows that t c ^),k — t c (k)-i.k < ^fc for all fc- We also define sequences 

xo,k, xi.k, x 2 ,k,---, x c ( k ) t k G K ™ ( 22 ) 

for fc > iV as follows. We set x$_ k = x and xi^ = x + (t\ tk — to yk )v . k , where v = v a , k G G £ j[0,x, k] 
satisfies the requirement from Claim 4.1 for the pair (to,fc,^o,fc) = (0,x). By (18), we get 

\\xi, k -x\\ < h k 6(D) = ^, (23) 

so xi.k G L>. If c(/c) > 2, then we set x 2 , k = x\. k + (t 2 , k - h,k)vi,k, where i>i jfc € G e f [h, k , Xi jk , k] satisfies 
the requirement from Claim 4.1 for the pair (£i,fe, ici,fc)- Reapplying (18) gives 

F2,fc - x lyk \\ < h k 8(D) = — , 

4fc 



so (23) gives 



|x 2 , fe -x||<^. 



Therefore x 2 ,k G £>• We now repeat this process using x 2 , k e D instead of xi. k . Proceeding inductively 
gives sequences 

Vi,k G G e f [ti t k,x it k, k] 

and sequences (22) that satisfy 

Xi+l,k = x i.k + {U+l,k - k,k)Vi,k 

for i = 0, 1, . . . , c(k) — 1. In this case, 

<th< (L + 1 ) jl = t* (d) + j^i, 

4/c " ^ fe y 4fc V ; 4fc " 2' 

by the choices of T and k > 2. Therefore, 

ii -ii c ( fe )T ^ T 

||*i, fc -*|| < < g 

for all i and fe. It follows that the sequences {#i,fc} lie in D. 

For each k > N, we then choose to be the polygonal arc satisfying x 7r ( fc )(0) = x and 

**(*)(*) = / e (7*(t),a; w(fc )(t) +r fc (t)) +« fc (7)b(t)) (24) 

for all t G [0,T] \ 7r(fc), where Tfc(t) is the partition point U yk G n(k) immediately preceding t for each 

te[0,T], 

Zk{k,k) -=Vi,k- fe{U,k-,x^k){t it k)) Vi,fe (25) 
the <E Gj[^ i fc,x T (fc)(^ i fe),fc] satisfy the conclusions from Claim 4.1, and 

r fe (f) := x w{k) (T k (t)) - x Mk) (t) (26) 

for all t G [0, T] and fc. Then x„.( fc ) is the polygonal arc connecting the points x^k for i = 0, 1, 2, ... , c(fc). 
In particular, = x w ^ k )(U,k)- 

Since x^fc G D for all i and k, we conclude from Claim 4.2 that 

sup{||* fc (7*(t))|| : t G [0,f]} < Uf, K (l/k) + l/k -» 
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as k — > +00. Since ||i,r(fe)(t)|| = ||«*,fe|| < ^(-C) f° r an * S (i»,fc, i»+i,k) and all i and fc, and since 

\T k (t) -t\<h k ^O as fc —> +00 Vi G [0,f] (27) 

we get 

sup{||r fc (t)|| : t G [0,f]} -► as k -> +00. 

Since (24) has the form (4) from our compactness of trajectories lemma and f £ is continuous, we can 
find a subsequence of {x n r k )(')} that converges uniformly to a trajectory y e of 

y = fe(t,y), j/(o) = 5. 

By possibly passing to a subsequence without relabelling, we can assume that 

Xn(k) -> 2/e uniformly on [0,T]. (28) 

Moreover, since Xi+i.k = x^k + (U+i,k — U,k)vi,k € D for alH = 0, 1, . . . , c(fc) — 1 and k > N, conditions 
(20) and (21) along with Claim 4.1 give 

*(a?i,fc) < *(*) + t* 

*(X2,fc) < *Kfc) + ^ 
*(«c(fc),fc) < *(«c(fc)-l,k) + x- 

Summing these inequalities and recalling that /ifc < 7 gives 

*(s ilfc ) < *(x) + £ffi^ 

< + 

< *(i)+i(f + 7 ) 

for all i and fc . Hence, 

*(x«(k)(Tk(t))) <*(i) + i(T + 7) (29) 

for all f G [0,f]. It follows from (27) and (28) that 

x v[k) {T k {t)) -► y e {t) Vt G [0,f] as fc -> +00. (30) 

Since W is lower semicontinuous, it follows from (29)-(30) that ^(y e (t)) < ^(x) for all t G [0,T]. 

Now we consider a sequence {e(i)} of positive numbers converging to zero. Let t/j := y e u\ : [0, T] — ► R™ 
be the trajectories obtained by the preceding argument for e = e(i) for all igN. Note that j/j(i) G D for 
all i and t, because each of the polygonal arcs x n (k) constructed above joins points in D and D is closed 
and convex. Moreover, 

yi {t) = f(t, yi (t)) + [f s{i) (t, yi (t)) - f(t, yi (t))] (31) 

for all i and almost all t G [0, T]. Since ||i; 7r ( fe )(t)|| < 6(D) for all fc and a. a. t G [0,T] for all the polygonal 
arcs x n (k) defined above, we get 

\\Vi(t) - yi(s)\\ < 6(D)(t -s) for < s < t < f for all i. (32) 

Since the yi are uniformly bounded and cquicontinuous, we can assume (possibly by passing to a subse- 
quence without relabelling) that there is a continuous function y : [0, T] — > D such that 

yi —* y uniformly on [0, T]. (33) 

We next show that y is a trajectory of /. To this end, we prove the following claim: 
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Claim 4.3. f e{i ){t,yi(t)) - f{t, yi {t)) -> in L 2 [0,f] as i -> oo. 

Proof. Since — ► y uniformly on [0, T] and / is locally bounded and locally uniformly continuous in the 
x variable, it suffices to show that 

Si(t) :=fe(i)(t,y(t))-f(t,y(t))^0 in L 1 [0, f] (34) 

as i — > oo. We do this by adapting a standard mollification argument (see for example [13, Chapter 8]) 
as follows. We first extend y to all of R by defining y(t) = y(0) for all t < and = y(T) for all 
t > f. Recall that we also defined f(s,x) = for all s g [0,T]. It follows from (32) and (33) that 

:=2w /iZJ (sup{|||/(t -e(*)«) -i/(t)| | : |z| < l,t eR}) (35) 

as i — > oo. Moreover, for < t < T, we can change variables to get 

]\Ht)\\ < f \\f(t-s,y(t))-f(t,y(t))\\Ve { i)(s)ds (by (5)) 
= y ||/(t-e(i)*,y(i)) - /(t,i/(t))||»7(*)d* 
< y i ||/(t - e(t)z, y(t - e(i)*)) - f(t, y(t))\Hz)dz + 
= Jj\g E{i)z (t)-g(t)Uz)dz + ^i) 

where 

ff(t):=/(t, »(*)), ff e «*(t):=5(t-e(i». 
Notice that g G L 1 ! *^ and that 

||3 eWz -5l|i<2|| 5 ||i V*. 
Applying Minkowski's inequality for i 1 [0,T] therefore gives 



IN|i< J \\<fW'-g\\ lV {z)dz + fn(i). 



Moreover, 

\\g e{i)z -g\\i^o 

as i — > oo for each z G [— 1,+1], by continuity of translation in the L 1 norm (see [13, Proposition 8.5]). 
The desired convergence (34) therefore follows from (35) and the dominated convergence theorem. □ 

It therefore follows from Remark 2.8 that a subsequence of {yi\ converges to a trajectory of / 
uniformly on [0, T]. This must be the aforementioned function y, as desired. Again using the lower 
semicontinuity of \D r , we therefore get 

*(!/(*)) < liminf tt(tfe W (t)) < tf(ar) 

i— >oo 

for all t G [0,f]. 

The strong invariance asserted in the theorem is now immediate. Indeed, let x a G S, T > 0, and 
<p G Traj T (.F, x a ) be given. We next show that 

i := sup{t > : *(<^(s)) < $(x ) for < s < t} = T, (36) 

which would imply that <j> remains in S on [0, T}. To this end, note that if this supremum were some 
time i G [0, T), then the lower semicontinuity of ^ would give 

< *(*<,)• (37) 



12 



In particular, x := <j>(t) E S. Let / G Cf([0, T—t\,x) satisfy the requirement (U) for F and the trajectory 

[0,T-i] 3t^y(t) :=<f>(t + t), 

and let 7 > be such that f(t,x) E cone{F(x)} for almost all t E [0,T — t\ and all x E -fB n (x). By 
reducing 7 > as necessary, we can assume that jB n (x) C 
By uniqueness of solutions of the initial value problem 

y = f(t,y), y(O) = 0(t) 

on [0, T — t], the first part of the proof applied to / and the initial value x — 4>(t) E S would give 
t e (0, T - i ) such that 

*(0(t + t))-*(0(t)) < Vte[0,t]. (38) 

Here we use the fact that the trajectory on [0, T] constructed above for / starting at x can be extended 
to [0, T — i], by the linear growth assumption (C3), and therefore coincides with y by our uniqueness 
assumption in (U). Since <f> remains in S on [0, t\, summing (37)- (38) would then contradict the definition 
of the supremum t. This establishes (36) and proves the theorem. 

Remark 4.1. The preceding proof provides a constructive approach to finding viable trajectories for our 
Caratheodory feedback realizations / that remain in S. As suggested by [14], an alternative but highly 
nonconstructive proof of Theorem 2 would proceed as follows. Let x(t) be any trajectory of F starting 
in S. By Condition (U), x(t) admits a feedback realization / E C[0,T], and our Hamiltonian assumption 
gives ((f(t,x),0),q) < for all q E N* im (x,V(x)) = {(£, — 1) : £ € d P V(x)}, almost all t > 0, and all 
x E U, where epi (W) := {(x,r) : r > ^(x)} is the epigraph of "J". It is not hard to deduce from this 
(cf. [7]) that (f(t,x),0) E Tf pn<Sr) (x,r) for almost all t > 0, all x E U, and all (x,r) E epi(*), where 
T B denotes the Bouligand tangent cone. Applying the measurable viability theorem (see [15, Section 4]) 
to the dynamics F(t,x) — {(f(t, x), 0)} provides a trajectory t 1— ► (4>(t), ^(x(0))) for x = f(t,x), y = 
starting at (x(0),^(x(0) j) that stays in epi(^). This requires / to be modified outside U in the usual 
way. Hence, &(<j>(t)) < ^(x(0)) < for all t. By the uniqueness part of Condition ([/), <p(t) = x(t) 
so x(t) stays in S. Unfortunately, the preceding alternative argument is highly nonconstructive, since 
the proof of the measurable viability theorem relies on Zorn's Lemma to construct the trajectory (f>(t). 
One natural question which should be considered is how our Euler constructions from our proof could be 
used to build numerical schemes for approximating viable trajectories for Caratheodory dynamics. This 
type of result could be useful in physical applications. This question will be addressed by the authors in 
future research. 

5 Strong Invariance Characterization 

As we saw in Example 2.2, the Hamiltonian condition that Hp(x, Ng (x)) < for all x E boundary^) 
is not necessary for strong invariance for (F,S); there, (F, {0}) is strongly invariant in R™, but the 
Hamiltonian condition is not satisfied, and F is upper semicontinuous but not lower semicontinuous. On 
the other hand, if we strengthen our assumption on F to 

([/") Condition (U) holds; and F is lower semicontinuous, and closed, convex, and nonempty valued. 

then we get the following strong invariance characterization: 

Theorem 3. Let F : M™ =^ M™ satisfy (U^) and S C R" be closed. Then (F,S) is strongly invariant in 
R™ if and only if H F (x, Ng(x)) < for all x E boundary (S). 

Proof. We showed the sufficiency of the Hamiltonian condition for strong invariance in Theorem 2, so 
it remains to show the necessity. We do this by extending an argument from the appendix of [1] to 
non-Lipschitz F. Assume (F, S) is strongly invariant. Fix x E boundary (S), v E F(x), and ( E Ng(x). 



13 



Using Michael's Selection Theorem (cf. [20]), we can find a continuous selection s : R n — > R™ of F for 
which s(x) = v. Choose a > satisfying the condition for ( to be in Ng(x). 

We can now use the local existence property to find t > and a trajectory <j> : [0, t\ — > R™ of the 
continuous dynamics y >— > s(y) starting at a;, so 0(0) = s(0(O)) = s(x) = v. Since G Trajf(F, x) and 
(F, S 1 ) is strongly invariant in R n , it follows that e S for all t e [0,f]. This gives (C,0(i) - x) < 
cr| — x|| 2 for all i € [0,i]. Dividing this inequality by i £ (0, f], and letting i — > gives 

<£«> <*]jmt| | (</>(*) -x) A|| 2 =0. 

Taking the supremum over all v £ F(x) and noting that x £ boundary (5) was arbitrary gives the desired 
result. □ 

Theorem 3 is no longer true if the requirement that F be lower semicontinuous is dropped, as shown 
by Example 2.2. 
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